Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

remove records of deleted pods from failure stores automatically and add an e2e test #2560

Merged
merged 3 commits into from
May 26, 2020

Conversation

cofyc
Copy link
Contributor

@cofyc cofyc commented May 26, 2020

What problem does this PR solve?

fixes #2459
fixes #1464

What is changed and how does it work?

Check List

Tests

  • Unit test
  • E2E test
  • Stability test
  • Manual test (add detailed scripts or steps below)
  • No code

Code changes

  • Has Go code change
  • Has CI related scripts change
  • Has Terraform scripts change

Side effects

  • Breaking backward compatibility

Related changes

  • Need to cherry-pick to the release branch
  • Need to update the documentation

Does this PR introduce a user-facing change?:

NONE

@cofyc
Copy link
Contributor Author

cofyc commented May 26, 2020

/run-e2e-tests

@cofyc cofyc requested review from weekface, DanielZhangQD and Yisaer and removed request for weekface and DanielZhangQD May 26, 2020 11:36
@cofyc cofyc changed the title remove records of deleted pods from failure stores automatically remove records of deleted pods from failure stores automatically and add an e2e test May 26, 2020
@@ -201,6 +201,11 @@ func (tkmm *tikvMemberManager) syncStatefulSetForTidbCluster(tc *v1alpha1.TidbCl
return err
}

// Recover failed stores if any before generating desired statefulset
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should also try to recover for TiFlash.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

Copy link
Contributor

@DanielZhangQD DanielZhangQD left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Yisaer
Copy link
Contributor

Yisaer commented May 26, 2020

/merge

@sre-bot
Copy link
Contributor

sre-bot commented May 26, 2020

Your auto merge job has been accepted, waiting for:

  • 2294

@sre-bot
Copy link
Contributor

sre-bot commented May 26, 2020

/run-all-tests

@sre-bot sre-bot merged commit c2d19ac into pingcap:master May 26, 2020
@cofyc
Copy link
Contributor Author

cofyc commented May 27, 2020

/run-cherry-picker

sre-bot pushed a commit to sre-bot/tidb-operator that referenced this pull request May 27, 2020
@sre-bot
Copy link
Contributor

sre-bot commented May 27, 2020

cherry pick to release-1.1 in PR #2565

sre-bot added a commit that referenced this pull request May 27, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
4 participants